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TITLE: DATA-DRIVEN IN TERNET SURVEY SYSTEM 

BACKGROUND - FIELD OF THE INVENTION 

This invention relates to benchmarking different surveys, specifically benchmarking 
of Internet based surveys, 

BACKGROUND^URVEYS 

Surveys or polls axe conunonly used to collect information. Over time a survey may 

be modified. Also once a survey is complete another different survey may be used to collect 
follow-up information. It is difficult to compare different surveys. It would be valuable to 
be able to simply see the results of a survey as a number or an index that would have 
meaning over time. 

SUMMARY OF THE IN\^NTION 

In accordance with the present invention a method of creating benchmarks for 

surveys that are used to graphically display over time and over multiple different surveys an 
overall trend. 

Objects and Advantages 

Accordingly, beside the objects and advantages of the method described in my patent 
above, some additional objects and advantages of the present invention are: 
1 . to provide a method of assigning goals and weights to survey elements. 
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2. to provide a method of determining an index based on survey results against said 
goals and weights. 

3. to provide a graphical view of the index of related surveys over time to show trends. 

4. to provide a professional web-based survey system that supports various types of 
survey questions and also supports the necessary goals and weights necessary to 
produce an index for each survey. 

DRAWING FIGURES 

In the drawings^ closely related figures have the same number but different 
alphabetic suffixes. 

Fig 1 illustrates the survey system process flow including the provisions for 
benchmarking. 

F i g 2 i 3 - a structural vi o w of the Gurvoy ayst e m of F i g 1 

Ft g£r3 A -th rough 3 B ara th f e e vevsiomj ofun exampl e oufvey; 

F i g ^ io Q tobl& illuGtraring the goa l s, w ei ght s , and index cdculationgfor th e 
qu e sr i otis in the exampl e o itfvey of Fig 3A. 

Fijg 5 is a grftph showing thev r e cu l t r j and indox for the e xample surv o y of Fig 4, 
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DESCRIPTION OF THE DWENTION 

Surveys arc all different, even different versions of the same survey. These 
differences can be due to questions added, questions removed or questions modified. 
Question modifications can include changing wording, changing options or changing types 
(changing a close ended question to an open ended question and vice versa). 

Benchmarks provide a quantifiable way to conceptually grade and measure the 
success of a survey against goals. 

On e way to understand th e cono e pr of a s urv e y tenofamark is to coniiidoT an example 
n r i ver which flood? ) from tinig to tim e ^ A stirveyor of a town through which the river 
pQiiaes plac es a mar - k on a parman e nt objoct next to tho rivor (e.g. a bridge pior> or t he 
''bench" of the rivar bank). The bench m ark g orve s- aS" » refere>nce for water teve l 
ob ser valk vBfe-^^he-beite hmark indicateo whon tho iwey - is at - f 00% of iti j capacity. Th e 
heHeh mark often has a gcalo to rnoosme - tb e number of feot below flo od l evel a nd th e 
m^mbene f feet above flood lev e l. Wh e n heav>^ rains fail, th e reMid&nbj of the town can 
monitor th e r i ; « o of th e riv e r aga i not tli e b e nchmark and make d&cisi ^ TO bas e d on the trend. 
If th e ri v er ! & beiow the 100% mark and the t r e nd is d e or e agjiiig^ the r e oidentr . G o rnf o rt tit:4y 
will stay homB. Howovor, if the river is riaing ctoae to th e- l - 00% mark ojid it io Dt t41 - Fai - nwg, 
fe h e r e G i d en tu may c vocuate - low lying ar e ajt. Wh e n the r i ver rif; e ft abov e (he be nchmnrk, tho 
restdenta cnn prcidict the extent of tho floodin g by th e m e asure of the waUer levei ab o ve- the 
bonclnnark. While there are - t i m es wh o a -ebi > eTvation of th e benchmark and calculating itr . 
tr e nd ar e not urgoiit, di e r e ar e other tiinea whan immediate i cauUs and tr e nd analy s is -i s 
eritica l to deoimon making. 

In tho oxamp l e of th e ri^ -e r benchmark, the nam e titingy the wal CT je wU io being 
measur e d over tim e . Howev e r, m summarized aboverin a question - based uurvey, the 
qt i e otion s change over time. Th e pr e sent inve n tion provideo oygt e mn and mathoda fo f 
applying tho concept of benchmarks to qaeflliort - baflod surv e ys. 

.These benchmarks transcend surveys and differences within these surveys including 
question changes and wording. The benchmark uses an index that works in much the same 
way that a stock market index works (by selecting key stocks, weighting them and 
monitoring their acdvity as an indication of the overall stock market activity).- How e ver 
unli ke the rivor e xample which mca o u r es only one thing ( i . e > the water leve))« and unlike the 
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sfeeejf4H dex ex a r npL e which li/jes tm oxiotiug numb e r fcr the s i ame th i ng (Lg. th & prico of a 
c e rtain e i tock) in th fr4 ftdex col e u l a t i o iirthtf pfes e nt invctidon prov i das a aurvey s yst e m H^tk^fr 
inciudos Q meona for t iBsi -g nm^ goal answer val ae s and wei g ht t* t o diffe t- iag { $urvQy qu efiti on s 
to produc ft an index which traiiocenda the dH - fer e aces in tfao queottons over time. 

It is not uncommon for surveys to be conducted more than once. Not only can 
benchmarking help measure the objectives of a survey and compare surveys, but also, by 
tracking them over time, measure progress towards overall market research objectives. 

Fig 1-Survey Syst^ Overview 

The survey system provides a computer network that can be used to design surveys 
in a way that the survey results can be tallied to determine an index, and the index can be 
correlated with the indices of other related surveys to produce a graph of the trends of the 
success toward the goals of the surveys. In the preferred embodiment, the survey system is 
implemented as a web-based survey system. Fig 1 illustrates the process flow of the survey 
system. Fig, 1 includes information on the physical structure of the computer network of the 
preferred embodiment, the software and database structure, the functions that the various 
components and users may use, and the data flow paths for the various actions. In the 
preferred embodiment, the survey system comprises a secure server 100. a server web site 
110, a client web site 150, each coimected to a network 170. After client users 130 sign up 
for membership, they are able to create and modify surveys by securely accessing a survey 
builder 180. Surveys are defmed using predetermined fomiats for various types of 
questions. Client users have objectives for their surveys. Each question is assigned a goal 
answer value relative to one of the objectives. The survey system provides a means for 
assigning weights that are used to tally the responses to determine an index for each version 
of a survey. The survey system provides reports showing the results of the survey, including 
graphs of the indices of the various versions of surveys showing the trend of the success 
towards the goals and objectives. 

F i j; 1 w il l b e diBCiiBsed mor e in detail bel osv. 

Figy 2 Survey System CompiitM' - N t it^vork Structure 

Pi g 2 i li us trat eG th e fltruotural view of a proforrod embodim e nt of the eurvoy tj ystem 

of Fig !. The mrvsy fiyfltem comprio&a a oecura sttrver 100, a server web sit e . I tO, d. cl i ont 
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web s ite l ^S Q, e ach coniiGctod to n. n e twork 170, Tho oocurc r^ver 100 i ftoiiidc G o ilarnboso 
3Q Q. lu tl>e prof o rr o d e mbodiment, tho database 20 0 ■) « an Oioc I q dat^ ^b a 9e mnu a g cm ont 
syot e m that indud oa a member database, ft client Gurv e y damhaoo, ij urvoy templaies 
database, o cliont rospond e nt/othar data djttabase, and a - respondent m e mb e r dotftboQO. 

The surv e y biaidor 180 io accoosed via tho oaoma Gcrv o r we b- sit e 110. Th e &urvoy 
b u tf d e f ■14} 0 seour e Jy occegfl o a th e databa * > o 200 to mnintftin data l e gtirding The m<>inbers, 
c li ent Gu r vey f j, > >urvey teniplat o n, cl i ont ref j pond o nt domographico, and rcopoHdems. The 
seeit r e s e rver 100 and o o rvcr ^veb aito 110 cou]d b e- iryip l ement e d on a a i ngie computer or 
inuUtplo coniptitGrs. If impl e ment e d on oeparato o o rnp u tero (at ) ahowa i n F ig 2), tho i i o our o 
connection could be iniplmTiont e d as n direct conncotion, a pri vatO Hgt etwork, or a ^iniial - 
private netsvork (N'^PN), a a known in the im. in nonie embodiments, the gccur e s e rv e r 100 
l ^& fe th e client wo b nito 150. 

The cliont us e r 130 can aloo ppeo i fy demographics for the typejj of i ndivi duals they 
want to rospond to the ourvcy. After a aurv e j^ haa be e n croatod, or modified to cre ate 
anothor veroion of on existing -s urvey, the client ^loor - K^O can pout the fiurvey to tho eli o nt's 
wftb aitc i50. Tho refiponrtca to survey queGtiono are returned to th e aeoure server 100 an 4 
datnbaoo 200 v i a network 170. 

sha v v £j differen t typo of i ndividuals who may re !i >pond to i)urveyj3. Rospondont - 
memb e rs 120. cliont useru 130 , panelintit 140, and other -s ui-vey targets 160 may respond to 
purv e ya via their own oomputcro, namely, ro^pondont computoro 220, ob'cnt uaer comput e rs 
230, pgnolist oompatoro 210, and liurv o y targot computoro 260, roGpoctivaly. The - retjpond e nt 
computcr o 220, cliont user computera 230, panoHGt oomp u tern 240, and survey target 

if-ftefe^ 'ork cHont nppiioation, prof o ra bl y a - w e fe brow!ier. 

In the pref e rred ombodimontj the aocoas to the survg^y builder and t^urvey^? in via tlio 
World Wide Web (W e b) using w e b H e i^ o ro and s vob bro>v9erft (i,e. syob olientfi); howev e r, in 
a l ternate ■ embodimento tho Pender gito and - ctient site could b e impiementQd as anoth e r typo 
of n e twork i mrvor and tho cheat softwaro 0.0 anothor type of n etwork application (r -athe^4haa- 
a web brows e r). 
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R eapondant Tnemberg 120 and pan e l i at fl 140 also may securely aaceca th e s e rver web 
a it^ 1 .10 v ia th e n etwork 170, for exanipt e to - iii i gH up f et ^^ e m b ership, view aoriignment 
notifiOrttio n sj, - oi to manage information about fliemaelv e s. 

FBg 3A ttux^uggh 3B An IHustrotivci EKumpk 

In e xplainmg the oporation and fo^or e g o f the surv ey s yst e m, it may be h e lpful to 
conmder an ll l uatratLve example. Fig ? j 3A, 3B, and 3C i ltuotrat e thr^ vevnion g of a s urv ey 
to-ift ight be given by a -h ypothettcai potitico l caiujidat e cu diffe r ent po i nts during that 
candidate's firat four year term in office. The candidate hm e e rtn i n objeotives ouch as be i ng 
popular, baing considered - ft»-p erfofmi - ftg well, and> most UTVf>e:Ftft H ty - being - r e elected. 

Su y vey 1 (301)^ shown in Fig 3A^ is tak e n dur -i ^g die isecond year in office. Survey 2 
(3 02 ) , a h o wn in Fig 3B, i g take »>-d uring tho third year in office. Survey 3 (303), shown in F i g 
SC. k , mken duri ng ^i e fourth ye ar in office, on tl>e day befor e Bleeiion Day: 

Fig 3 A ohowB tiurv e y I (301) compo s ed of various quest i ons designed to meaaure t he 
candidate's obj&ct i veo of popularity 3 10, perfonnanc e 320, and re electi o n 330. Survey t 
(301) haE? different typ e s of quofltionfj w i tti differ e nt types of unsweyg. For example, the 
pep i Uarity and re e lect io n <t u estionfi (3 1 1 and 33 1 , re ? jpeotively) have ^'yes" and "no" 
ttn^itwe ro (see 312 315 and 332)^ and the performmioe quest i on (321 ) fra-a d i rect response 
qites tion having a liinited ran ge- of anfeiw e rs valu e » (i.e. 1 5) (ae e 332 326). 

Fig 3B rjhow£i £>urvey 2 (302) tds& eetnpo e ed of varHoos - quostions designed to 
meuoiire tho candidate --s- obj 6 etiver; ef p opularity 3-l Q, performance 320 ^ an d- ^e ■e l e ctie^l^3 Q . - 
44eweve^^- ^QV r that th e candidate hm be^n in off i ce for over two year s ^ t h e- candidate ha?? 
beco m e H io r e interested oP: how c on st i tuejits stand on t i^ ee rtain t SiHtes. Survey 2 (302) 
addij a no w - objeet i ve, stand on ieouo s 360, A new type of queation used. In querition 361, 
anowers are a form of multipl e choice where the choiooft ind i cat e a contin uum -ef agr c oment 
Th e r e w e r e aloo ohang e o en the queat i ona between survey 1 (301) and gurvey 2(302). For 
exojopje, and artkudato 3^7 w e re adde d t o measure tho popularity objective 3 10. 

Aiso, in the perfonnanc e objective 320 qu e iitiono, doineatio policy 32^1 wao dropped and 
replaced w i tk for e ign po l icy 351; s ocial s ec ur i ty 352 and defense 353. 

Fig 3C shows survey 3 (3Q3> - also oomposed of various questions deoigj^od to 
meaGur e the candidate's objeotivejj of poj^ularily 310, performance 320, ? uand on isDues 360, 
and I'e ol ection 330, — How e ver, on the eve of r e e l e ction^ tho candidate needa to know how 
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^H= ^e6nt dbaoter and th e war are going to affect r e eiecL i on, nnd tf the oQiid i date currenUy 
4tft6 e nough voteti to win. Tinio ^ In of tho euucnco; ba33d on tho immediate, r e sults of the 
€wv e y, th e candidat e will spend tini i e imd niougy to en i fiure that the objective of re ot e ct i on i s 
ff iet. Sui voy 3 (303) mm a new ty p e of question to meaaurc the re election objecti ve 3^i&, 
¥ h e Vili vot e '' qu es tion 378 in in tho for m of a positiv e ota t emon t a bout the v o te and tl ^ 
an ^j w e rs 379 are true or fQig o . Thore worn oliso other o hanges in the qit esfckme-b e fe we e H 
surv e y I <aO - W - T^ig 3 A), survoy 2 (302, Fig 3B) and now surv e y 3 (303). F o r exa i iiple, 
affable 3^6, which wao added in aurvoy 2 (302. Fig 3BX has b ee r^ replaced w i th ''good 
G poa l cQr" ' 38 6 in sm -v oy 3 (303, Fig 3C) to metifiure the [x >p utarity objecti ve 310 in a slightly 
different way. A\bo^ i n the p »r-fo rn i anc o obj o ctive 320 quamionfl, fo fei gn polioy 351 and 
Gocin i secur i ty 352 were dropped and disaster 351 and th e war 359 were added. Th e 
quest i ons r e garding - coa s titiienta^ ijtand on mimn ^ver e-atl ehimg e d ; - Th e tt ocudi security 
question 363 m/qs i nverted by romoving tho word ""NOT' and placed first as q H estio» 365 
(modified i;ociul sec ur i ty question). QuootioiiG ou estate tax 366 and going to war 367 
rephiced the queutiong - about floeial s e curity investment 362 and social program s 364. 

In th i fv exompl e , each of the t]:)r o c v e rsion!? o f- the candidate' s surv e y, i .e. fiurv e yr i 1 
through 3 ' (301 through 303), h a d a diffe re nt n u mber of reftpon ae c, di ff er ences in the 
e bjeet ^ vcs bei n g m e asur e d, and difforonoer i be^two en Qim i la r question s. A d iitated ub< :)vtf, 
t her > 6 dif ferenoco mako it difficult to compare t he re sults of one version of the su r ve y t o 
another. The present invention provides jyotems and m e thods that inolude det e nnini - ng an 
index for each ourvey that i ^ i a moat s irro of tho respono o Q again o t t t ie goalf r- and obj e ct! v e e of 
th e ijurvey. Tho index f - o f e ach surv e y k\ u inea i iure against a boncfainark that trans ee nds th e 
<ghaB ge a in the quoGtioniVQuestions types, and object i v es of e ach voraton of tho ouPi/oy. 

How Benchmarks Work? 

As part of the purvey design, clients 130 can define benchnaarks. Goals and weights 
are used to evaluate an index that quantifies the "success" of the survey. The index works in 
much the same way that a stock market index works (by selecting key stocks, weighting 
them and monitoring their activity as an indication of the overall stock market activity),-^¥4H« 
vviJj be explained, hi th e fo l (owing aoctlon, by rof erring back to th e illustiativc example of 
the hypothetical political caudidato^ 
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Fig 1 Tallying Responses to Det e rmine an Index 

F i g - 1 i s a Uible i l luHtmting the goalfl. woighto, find index cx^icu l atiou Q for the 
que- ' itioni) in the exmnpie ? mrvoy - 1 (301) of Fig 3A;-lii praotio e , th e sui-vey ig responded to 
by a larg e nu i t ^ r oF reflpond e nta (130); how e ver, for aimplioity Fig A ohovvs only the 
Fes ponjjer . of four bypothetiwl raapondontG (l i hown in colummi ^30a, 430b. ^30c, and 43Qd ; 
refipoctivo)y)> Tho first coh i mn reform to the q uec tioos - from Qi>rvey I (301) m tlto same ordei- 

Ifrc-HH jt^r to cqIouIiUo an index, the rooponoo to oaGh qiiest i on fir s t immt b e troiiolat&d 
to fi number vaiuc, A numbor of quootion typoa ar e known in th e art. Different trangiations 
m ^ H ^ for each typ^ of qoQr . tion. 

Target values can be assigned to any number of questions on the survey. 

Weights are then applied to these questions indicating the impact any one question 
has on the overall survey index, reJative to other questions on the survey. 

An index is then calculated for every survey that is completed by a respondent 
The index is a percentage that indicates the proximity of the survey answers to the desired 
goals with 100% indicating that the completed survey likely meets the desired goals. 

Th^ flurvey a y o tem has a pred e tennin e d Lianslntion for Qcch queotion type> Tho 
fe Mowing table shcw - o some exumplo tranohitiona. 



RESPONSE 


VALUE 


Strongly disagree 


& 


Tend to diaagroo 


4 


Don't knew/No opinioH 




Tend to afiree 


3 




-1- 




+ 






TRUE 




FALSE 





For more complex question ty p e ?) [e.g. "check all that apply" or matr i x r e^gpons c rrX 
oth e r typ e o of calcuJationB ar o mad e . Exampl e s of fun ai ons used i n mor e compl e x 
caiculationij ara: 

^ — SUM added up nil tho valuon of the fonponfioo 
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^ — COUNT counting the ruimber of vnktes greater than g & fe 

■» — EXISTS returning I for each item that is m a rked 

^ — NOT EXISTS r eturning 1 for each it e m that i n not marked 

^ — RO W COUNT count i ng the numb e r of row& m a matrix that ha s an flnswe r 

-* — S UBS T RACr subtrac t the value from a prod e termiaad constant 

— MyL17PLE multip l e the valuo by a prgdotarminod coastan il: 

« — -NOT convert 0 to I and visa versa, 

Ttta ourvey doaignor< e ;g. a c l ient us e r 130) s e lecta quest i on typeo from a 
pre de ter mi ned set of qu i »ation types guppovted-b y-^e ffi p k -tes- li>t h e fi urvey system and e nt e rs 
th e text for eac h- qu e st i on and its poocibJ e ro&ponoeG, The survey gyotem shovva the - wrv e y 
de(iigner th e range of renponae voiue«. For e xample, in cir e ating s urvey \ (301) th e ourvey 
desi gner first *j pecifi e » t h e popuiarity object i v e 310, aelect s a matrix qucF.tion ty[>e, enters the 
word i ng for ihe question (e.g. 311) and th e n enters the su b que fgt ion wording reg afdmg 
bon eoty 3 12 sv i tli pooQiblo respo H s e s of *'yes'' and "no- ; Ifithie case> the ourv e y system 
would akow - a rang e of possibl e imswer values of eithar 0 (fQr- - 'no'') or I (for '* ycir i "). 
Ltk e wiser aftethe r <»bj e i i tiv»^ 4H q «e £i t ioit typ e is r4Hatored for the p erformttnee o bject i ve 320, 
When entering the sub quo&tion on tanor? 333 the pos3iblo range of ar i ^w -e r - v alueQ i s i 
through 5 with 5 fa ct ng - the best Target vaiu e ?i can be assign e d to any nuirtber of questio i ^e 
on tho - gujvey; The target valu e ia the goal anQwer value (see eekmn 4 i 0)fer each -q u e stkMi .- 
Fe r oxanipie. For rsub quoat i on on honesty 312, the goat w 1 (meaning aji anovver of yes, and, 
for th e mib yiesti o n on taxes 322v the goa l is only 4 (meaning good biU not oxool l ent). In 
th i s ca?»e the goa l \f \ Bot th e higheot poss f ble '^ :^ause our h ypethet ioa l candidate has l ea rned 
Uw{ y ou c an *t p le a s e all of the p e opl e all of the timo. 

We i ghts are then applied to these queotiona indicating the impact any one question 
has on tho ovcraU survey index, relative to other queGtiona on the survey, fn th e example 
^ own in Pig 4^ th e we i ght (aoo column 420) f o r th e sub quoi?tion on honcoty 312 frs4 j, the 
weight (column ^130} for trustworthy 3 - 13 ia ^, Lmd !jo foith. The ca n didate hofi s e t the weight 
(column dlO) for tho re election question {row 331) to SQ. - Th^ -v^' eigbt - fo i ^ each qu e Rtion i s 
th e pero e nta g e -o f the index (row ^5) that the qu e stion w i ll contiibute. In this onample^ the 
sum o f th e >veighta in the popularity objective 3 12 31 5 ia 20 or 20% of the index. The S H m 
of the weights in the pgjiforma.nc e objectivo 320 w 30 or 30%, The re el e ction qu e aHon und 
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objective \s 50% of the i nd e x for aurvoy 1 (301). Ag sho s vn nt row i5(> the? cum of th e 
waiglits in columi^ 120 is UK). For survey 2 (302), th e aa me questions ( fe.g, 312, 3 1 ^ . and s o 
forth)"WOH td h in 'e different weight v <tki €fi b e cause there ar e inore quei p tionri (e,g. 3*16 and 
3^7) ( i i i d Qii fldditionaf objective (i>e. staftd oiv issu e s 360). When inoc l ifyin^ atirvey 1 (3 10) 
to fonn survey 2 (302X tho ourv e y deoigner oooigrm n e^' goal answer vahie s and w^ight< t , 
with the s um of the woighta b e ing 100. 

An-inde^ m then caloulnt e d for ev o ry aiirvey that i s compteted by a reapo tKtef^t-.- 
Column 130a ohowg the r e aponoea by r e spondent 1. Column 4^0a -3 ht> w9 the cnlaiilut e d 
va l ue for each - r e eponfie, Tho oaioulatod vafuo ig the regponse tmower valu e divided by th e 
goaf anflwsr vnluo inultipl i ed by the weight. 

Calo " (RoDponco/Coal) *Woight 

The first respond e nt Qaow(>n>d tho honeflty oub querftion 312, yes, which tn t nslates t o 
a re^jpc m se valu e of I and calculated value of Sr-Tho trufi i fwo>lhy mb quoGtion 313 wafi al s o 
answ e r e d yea, whioh trnnalat e a to 1 and calculat e s to - 1 b e cause of tho lo s vor w e ight. Tho 
re^jpojise va l ue!3 t are translated and caicuLat e d for each quogt i on ond an index is calcutated as 
a percentage agaiuiit th e b e nohmark of 100%. The indoK for the survey qo q whole - ( e y - for 
a n y- obj e ctive) is calculated by suanmUig tho calouloted valueo and div i ditig by the sum of th e 
woightsand multiplying by 100. 

Index " ■ (SUM f{RoBpons e /Goal)*WGight)/ SUM(Woight>) = fc 100 

It should b e und e r - stood that o number oould be ca l culated by Qpply 44 ig goal answer 
va hfes and weights to the respoaoeii to all of the questiono that nigasu fe any particular 
objective. Althougb not Sihown in F i g g 4 through 6 for oimpiioity; a 5ub cndox for each 
objective could a i ao be- ^culated and graphed as a se parat e graph e l e ment. 

A di ffar cn t r e s p o nd e nt ind ent Lo calculat e d for each respondent to en ivey 1. The 
oeconct respondent answer e d th e honef i ty sub qu e st i on 312, no, w hr ioh tm i ^utes to a 
re B pon se valu e of 0 (s ee oohimn '130b) and calcu l ated value of 0 (a e s column 110b). The 
third respondent answ e r e d tlie honesty nub que^Jtion 312, no. which tranfltateo to a reiiponse 
¥a4ue- of 0 (^ee column - 4 30c) and ca l culated value of 0 (noe column llOo). [The th i rd 
reg vpondent doe s not particu l arly like tJi e candidate and wi l l notro oloct tho auHliduto, . ' )oo 

rn w \^\^ 
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As shown in row ^50 of Fig th<» tndox for rcapondont 1 (450a : ) - wa9 I07.5v 
indiouting that for thifi r e spondent th& candidate has exceedecl the goal. The iiu li ces o f 
r e? 3por>deftts 2, 3;<xh4 1 ( i 5 0b, 150c , 150d ) Avere 82, 1^.5, and 97.5 reBpe&t i veJy. The iT^d i oos 
of each reupondaat is added tog e thar nnd divided by the nimibor of respondents to calculat.e 
on avemgo index for a version of a survey, wlilch in th it» exampl e- for tsur v ey 1 15A (^60o). 
The av e rag e of a!l the rg ^ spend e ot i ndie e s for a version of n survey in the overall iridox for 



t f r e iu p o n de nt f i answ e r each question with th & c orrespond i ng goal ans^^ar va l u e , th e n 
the ind e x for the aiu vey will be 100, indicatiag that alJ the obj e cttvga to be measured by that 
survey have been m e t suoceosfully. Generally if the roopondonte answer below the goa t 
answer vnhi e o, tho i ndex wiW b e leoo than 100 and if the reapondeuto auGwer above the goal 
answ e r vahi es th e in de x will b o gjp e ater tlmn 100. Howev e r, becau^i e of weighting, a high 
anf-j w e r v al u e o n a - relotive ^ y higher weighted quest i on will h ove a mor e po s itiv e impact on 

Fig 5 Survey Resiiits 

Th e indon. i u a porccntuge that iRdioat€^4he - i?F 9 xlmity - of - the - wtw e y < > j^ 
defjired goals with 100% indicating that tho compl e t e d survoy tikely motata the d e s i red goals. 

Fig 5 show.'S a gr af jh 500 of tho ind i vidual reopondoa t in d ioo a (^1 50a, ^1 50b, ^50 o, and 
^5Qd) for i i urvey 1 (301). The roflultij Una 520 of th e survey 1 graph 500 ohows tliat 
reopondont 1 was above the nui-voy bonchmark 5t0v re/ j pondentn a - and^-w < ?ro - a l so closer to 
the- b e nchmark . b ut r e spondent 3 waa far beiow th e benchmart^ - . The surv e y benohmnrk 5 1 0 
is an i n de x for a hypotli e tical respondent who answ eFed4 he goal imswer vatu e- f or e very 
que ti tion o ' n - tke fjiH'vey, thus it is a numorical way of repre i^e ntiog - that ev e r>^ goa j and 
obj e ctive for the aurvoy wno meet, A graph ahowing tho individual respondent indices is 
v aluab le \n det e nnine the l e vftl of .fiunnr>rtfh &-efHf^ idnt: e hnr . on an irKitvid i ml ha fiii s. 
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